Using Textual and Visual Processing in Scalable Concept Image Annotation Challenge
نویسندگان
چکیده
This paper describes UAIC’s system built for participating in the Scalable Concept Image Annotation challenge 2015. We submitted runs both for Subtask 1 (Image Concept detection and localisation) and for Subtask 2 (Generation of Textual Descriptions of Images). For the first subtask we created an ontology with relations between concepts and their synonyms, hyponyms and hypernyms and also with relations between concepts and related words. For the second subtask, we created a resource that contains triplets (concept1, verb, concept2), where concepts are from the list of concepts provided by the organizers and verb is a relation between concepts. With this resource we build sentences in which concept1 is subject, verb is predicate and concept2 is complement.
منابع مشابه
Scalable Image Annotation by Summarizing Training Samples into Labeled Prototypes
By increasing the number of images, it is essential to provide fast search methods and intelligent filtering of images. To handle images in large datasets, some relevant tags are assigned to each image to for describing its content. Automatic Image Annotation (AIA) aims to automatically assign a group of keywords to an image based on visual content of the image. AIA frameworks have two main sta...
متن کاملUsing Machine Learning Techniques, Textual and Visual Processing in Scalable Concept Image Annotation Challenge
This paper describes UAIC’s system built for participating in the Scalable Concept Image Annotation challenge 2016. We submitted runs for Subtask 1 (Image annotation and localisation), for Subtask 2 (Natural language caption generation) and for Subtask 3 (Content Selection). For the first subtask we used an ontology created last year with relations between concepts and their synonyms, hyponyms ...
متن کاملBUAA-iCC at ImageCLEF 2015 Scalable Concept Image Annotation Challenge
In this working note, we mainly focus on the image annotation subtask of ImageCLEF 2015 challenge that BUAA-iCC research group participated. For this task, we firstly explore textual similarity information between each test sample and predefined concept. Subsequently, two different kinds of semantic information are extracted from visual images: visual tags using generic object recognition class...
متن کاملINAOE-UNAL at ImageCLEF 2015: Scalable Concept Image Annotation
This paper describes the joint participation of the TIA-LabTL (INAOE) and the MindLab research group (UNAL) at the ImageCLEF 2015 Scalable Concept Image Annotation challenge subtask 2: generation of textual descriptions of images noisy track. Our strategy relies on a multimodal representation that is built in an unsupervised way by using the associated text to images and the visual features tha...
متن کاملTags Re-ranking Using Multi-level Features in Automatic Image Annotation
Automatic image annotation is a process in which computer systems automatically assign the textual tags related with visual content to a query image. In most cases, inappropriate tags generated by the users as well as the images without any tags among the challenges available in this field have a negative effect on the query's result. In this paper, a new method is presented for automatic image...
متن کامل